Thermodynamic forces, flows, and Onsager coefficients in complex networks 
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We present Onsager formalism applied to random networks with arbitrary degree distribution. Us- 
ing the well-known methods of non-equilibrium thermodynamics we identify thermodynamic forces 
and their conjugated flows induced in networks as a result of single node degree perturbation. The 
forces and the flows can be understood as a response of the system to events, such as random removal 
of nodes or intentional attacks on them. Finally, we show that cross effects (such as thermodiffusion, 
or thermoelectric phenomena), in which one force may not only give rise to its own corresponding 
flow, but to many other flows, can be observed also in complex networks. 
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Onsager relations [l| constitute one of the most promi- 
nent results of the traditional non-equilibrium statistical 
physics In short, they explain why and how small 

perturbations of some system parameters can induce fluc- 
tuations of other parameters. 

The relations are derived from the assumption that the 
response of the system, which is close to equilibrium, to 
small external perturbation is the same as its response 
to a spontaneous fluctuation. Since the considered sys- 
tems are close to equilibrium the change in entropy dS is 
mainly due to entropy production diS, the rate of which 
can be written as 



ckS_ 
dt 



(i) 



where Fj are thermodynamic forces, such as the gradi- 
ent of 1/T, and Jj are flows, such as the heat flow. In 
the vicinity of thermodynamic equilibrium, the following 
linear relation between the Hows and the forces holds 



Jj — ^2 LjiFi, 



(2) 



where Lji represent the so-called phenomenological co- 
efficients, which have been proved to fulfil the Onsager 
reciprocal relations 



(3) 



Please note that the relation ^ implies that not only 
can a force such as the gradient of 1/T cause the heat 
flow but it can also drive other flows, such as a flow of 
matter or an electrical current. In other words, an en- 
tropic force Fi may not only give rise to its corresponding 
flux Ji, but to many other fluxes Jj in a dazzling vari- 
ety. Moreover, due to ([3]), one flow Jj causes the other 
Jj in exactly the same way and to exactly the same ex- 
tent. The thermoelectric effect is one such a cross effect. 
Thermodiffusion is another example. The proliferation 
of fluxes described above is the main reason why it is 
so difficult to perceive causality in complex systems, in 



which relationships between constituents may give rise 
to very complicated behaviors. Notwithstanding these 
difficulties, in the paper we examine effects of the On- 
sager causality in complex networks, which during the 
last decade have broadened the purview of physics. 

In a nutshell, real-world networks and their theoretical 
models are called complex by a virtue of a set of non- 
trivial topological features among which the most promi- 
nent are: heavy-tail in the degree distribution, tendency 
of nodes to form clusters, small world effect, assortativity 
or disassortativity among vertices, community structure 
at many scales, and evidence of a hierarchical structure 
(for an extensive review see Refs. 0,01). Since Onsager 
relations operate when the considered systems are close 
to equilibrium, in the following we will concentrate on 
equilibrium networks, precisely on exponential random 
graphs, also known as p* models, neglecting a huge class 
of evolving non-equilibrium networks. 

Exponential random graphs are ensemble models. 
They are already well-known for mathematicians @, 0] , 
and recently have also aroused interest among physicists 
[S E3] ■ As a matter of fact the methodology behind 
the models directly follows the methodology behind max- 
imum entropy school of thermodynamics [111 ], In order 
to correctly define an ensemble of networks, one has to 
specify a set of graphs Q that one wants to study. In the 
following we restrict ourselves to labelled simple graphs 
with a fixed number of nodes N. Next, since the set Q 
of possible networks has been established, one has to de- 
cide what kind of constraints should be imposed on the 
ensemble. The choice may be, for example, encouraged 
by properties of real networks such as high clustering, 
significant modularity, or scale-free degree distribution 
P(k) ~ k 1 . Then, one specifies probability distribution 
P{G) (G € Q) over the ensemble, which consists in max- 
imization of the Shannon entropy S = — P{G) ln(G) 
subject to the given constraints. The procedure leads to 
the Boltzmann-like probability distribution 



P{G) 



,-H{G) 



(4) 



2 



where Z stands for the partition function, whereas 
H{G) = 9jm,j(G) is called the graph Hamiltonian. 
The set {rrij} represents ensemble free parameters (like 
energy E in the canonical ensemble) upon which the rel- 
evant constraints act, and {9j} is a set of fields conju- 
gated to these parameters (like (3 = (fcT) -1 representing 
field conjugated to the energy E). Further in the pa- 
per, we will consider network ensembles characterized by 
a desired degree sequence {hi, h%, ■ ■ ■ , h^}, i.e. by the 
Hamiltonian of the form 181 



N 



H(G) ='£ i 9 i k i {G). 



(5) 



The ensembles are formally equivalent to uncorrelated 
networks with a given node degree distribution P(k) 0, 
which have been repeatedly used in recent years as the 
simplest (but not yet trivial!) models of real networks 

HQ [3. The 0nsa 

ger formalism applied to this en- 
semble will allow us to study dynamical response of the 
considered networks to external perturbations. 

In the following, we will study the simplest kind of per- 
turbation consisting in a sudden change of single node's 
connectivity, e.g. ki(to) = 0. The perturbation is partic- 
ularly well suited for the Hamiltonian ([5]) because nodes 
degrees are ensemble free parameters in the case. Let us 
also stress that the perturbation directly corresponds to 
frequently discussed problems of random or intentional 
removal of sites and links in complex networks, which 
have been considered in relation with such important 
issues as: resilience of real networks to random break- 
downs, their susceptibility to intentional attacks, and fi- 
nally the issue of cascading failures in these networks. 
Although, however, a number of analysis in the field has 
been performed, most of them may be classified into one 
of the two categories: the first one focusing on static, 
percolation properties of new networks arising as a re- 
sult of a given perturbation 14, lU, and the second one 
encompassing a variety of processes which excel at imi- 
tating specific phenomena (like clogging in the Internet) 
and give some insight into dynamical behavior of the con- 
sidered networks after such a perturbation [IF 



17, m 



The approach presented in this paper does not fall into 
neither category. Although in the paper we concentrate 
on a similar kind of perturbation the true challenge of our 
approach is to present how the most fundamental results 
of non-equilibrium thermodynamics can help in under- 
standing of complex networks. The approach is all the 
more important, since it can be applied to any ensemble 
of networks with an arbitrary graph Hamiltonian 

Thus, let us apply the Onsager formalism to ensemble 
of networks described by the Hamiltonian ([5]). Our first 
aim is to determine thermodynamic flows and forces ([1]) 
which appear in the networks after the perturbation con- 
sisting in a sudden change of a single node's degree. In 
order to do it one has to expand the ensemble entropy 



S(ki, k,2, . . . , &tv) about equilibrium as a power series in 
its independent variables 

1 d 2 S 

diS = S-S eg = - Qk dk ^ ki ~ hi ^ kj ~ ^ 

where dS/dki = 0. Next, computing the time derivative 
of the above expression one obtains a new microscopic 
expression for the rate of the entropy production 



a = Ih = ~^2dij(ki - hi) 



dt 



d(kj - hj) 
dt 



(7) 



where gij = —d 2 S/(dkidkj). Identifying the derivative 



■h 



d{k 3 - hj) 
dt 



(8) 



as a thermodynamic flow, and then comparing ([7]) with 
([T]) allows one to show that the term 



Fj = - ^2,gij{h - hi) 



(9) 



corresponds to the thermodynamic force. 

Now, assuming that the probability of a fluctuation in 
our ensemble is given by the Einstein formula P(diS) ~ 
exp^S 1 ] one can show that elements of the matrix g _1 
(which is the inverse of g) describe correlations between 
fluctuations 0, 0] 



9i/ = ((h - hi){kj - hj)) = (kikj) ~ hihj 



(10) 



At this point it is also worth to stress that from a physical 
point of view the parameters correspond to general- 
ized susceptibilities xfj 1 = —dhi/dOj (see Eq. (39) in [§]), 
which measure the response of hi to the variation of the 
field Qj . Having the ensemble averages [l{| 



(kikj) = h I 1 



hj(h 2 ) 
(h) 2 N 



(ii) 



one immediately finds that in sparse and uncorrelated 
networks described by the Hamiltonian ([5]), for which 
(h 2 )/(h) <lnN [i,[21|, the matrix g is diagonal 



9ij 



(12) 



The last result is interesting for two reasons. Firstly, it 
allows to simplify the expression for the thermodynamic 
force Fj acting on the node j when the studied networks 
are thrown out of equilibrium. Namely, inserting (|12[) 
into © one finds that the force is equivalent to the nor- 
malized fluctuation on the considered node 



Fa 



(13) 
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FIG. 1: Main stage: Schematic picture illustrating behavior 
of a network after the perturbation consisting in a sudden 
rewiring of all links attached to the most connected node to 
other nodes. Subset: Response function of scale-free network 
of sizes N = 512 with 7 = 3.2. (All Monte Carlo simulations 
presented in the paper have been averaged 10 6 times.) 



Secondly, it shows that correlations between fluctuations 
on various nodes are negligibly small. Although at first 
glance the remark seems to contradict the expected cross 
effects, further in the paper we show that the effects con- 
sisting in cascading development of different flows be- 
tween the nodes do really exist in the considered net- 
works. 

In the following, in order to examine the mentioned 



cross effects we will write the rate equation for kj — h 
which will make possible the detailed analysis of the ther- 
modynamic flows Jj ([8]) in the considered ensemble. Be- 
fore, however, we proceed with this equation let us dis- 
cuss structural and dynamical properties of the studied 
networks. First, since the networks are uncorrelated the 
probability of a link between any pair of nodes i and j 
with degrees respectively equal to k% and kj is given by 
Pij = kikj/((k)N). Next, due to the fact that the net- 
works are close to equilibrium one can assume that their 
dynamics after a small perturbation is the same as their 
dynamics in equilibrium. One can expect that the ana- 
lyzed networks make only small steps in the configuration 
space Q forming a sort of a reasonable physical trajectory, 
along which successive networks G appear with probabil- 
ities proportional to their weights, that is, proportional 
to e~ H ( G ^ (UJ). The simplest and physically the most rea- 
sonable method providing such a sampling is known as 



Metropolis algorithm [22j]. In the algorithm the ratio 



w 



ngo e - g(Gi) —ah 

P(G 2 ) e~ H (G2) e 



(14) 



is interpreted as the probability of making a transition 
from one network configuration G\ to the other configu- 
ration G2 (if AH < then w > 1 and such a transition is 
always accepted) . The considered difference between the 
two configurations G\ and G2 should not be too large, 
since then the acceptance probability w would be small. 

Now, having in mind the expounded properties of the 
considered ensemble, and assuming that during a single 
time step only one link may be added or removed from 
the network one can easily write the rate equation for 
kj — hj 



d(kj 



"3) _ 



dt 



\ 2) ijtj 



(-1) 



(+1)1- 



ki kj 
(k)N 

ki kj \ 

Pi 



mm e 



mm e 



M] 



i+6j) 11 



.(15) 



The first term on the right-hand side of Eq. |To]) corre- 
sponds to node's degree decrement by a link removal, and 
respectively the second term represents node's degree in- 
crement by a link addition. At the moment, our aim is 
to reformulate the last equation into the form similar to 
relation ^ . In order to do it let us recall two properties 
of the analyzed ensemble ([5]), which have been proved in 
[9(. The first property (k) = (h) is trivial and does not re- 
quire any comment. The second property, that is of our 
interest, relates the expected node's degree hj with its 
conjugated field 0j, i.e. hj ~ e~ 0j \J (h)N. The last ex- 
pression is only true in sparse and uncorrelated networks 
for which fields {6$} conjugated to nodes' degrees are pos- 
itive. Putting the mentioned expressions into (|15p . after 
some algebra one gets a new rate equation 



d(kj — hj) 
dt 



2 



2 A/ j hj 



1 



hj(h 2 } 
N(h} 2 



-h, 



(16) 



which after putting kj = hj in the second term (since we 
operate in the vicinity of equilibrium the assumption is 
reasonable) simplifies to the desired form @ 



d(kj — hj) 
Ft 



2hj ( hj fcj 

7V2 



E 



2hih 



2 h 2 



\ 3 



(h) 2 N 4 



(17) 



having the exact solution 

k(t) -h= e- L s* (k(t ) - hj , (18) 
and providing us with the matrix of phenomenological 
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FIG. 2: Amplitude of the response function versus 7 in scale- 
free networks of size N = 512. 



coefficients L describing non-equilibrium phenomena oc- 
curring in the considered networks 



2th 

N 2 
2tijh* 
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Now, let us discuss results of the last paragraph. At 
the beginning let us note that the equation (jTTJ) clearly 
shows that cross effects do really exist in complex net- 
works. Furthermore, the obtained matrix L is symmetri- 
cal. It means that the Onsager relations (J3j) hold in the 
studied networks, i.e. the effect of a normalized fluctua- 
tion occurring in one node Fi (| 13j) on the flow which is 
induced in another node Jj (|8|) is the same as the effect 
of Fj on Ji, regardless of the nodes' degrees hi and hj. 
Note also that the equation (fl~7|) can be written as follows 



(19) 



revealing the multi-component nature of the analyzed 
flows. The partial flows introduced in the last expression 
can be easily identified from the initial equation (|17| . 

(i) 

They respectively stand for flows Jj = LjiFi generated 
on the node j by other nodes i ^ j, and for the flow 
Jj^ = LjjFj induced on the node by itself. A simple 
comparison of the flows shows that in the studied case of 
sparse and uncorrelated networks ([5|) the following rela- 
tion holds 



v^.jf »jf, 



(20) 



which stems from the analogous relation between On- 
sager coefficients, i.e. Vj^j Ljj 3> Lij. The above re- 
lation causes that the partial flows J- 1 "* , giving rise to 



cross effects, are much smaller than the local flow J 

j 

In fact, the only networks for which the total effect of 



the cross flows is considerable are scale-free networks, in 
which highly connected nodes appear. 

Therefore, to numerically verify the obtained results 
we have analyzed behavior of scale-free networks (i.e. 
networks characterized by a power law distribution of the 
desired nodes' degrees P(h) ~ /i~ 7 , which 2.4 < 7 < 4) 
after a sudden rewiring of all links attached to the node 
with the highest degree k max to other nodes. Schematic 
illustration of the network response to this externally ap- 
plied disturbance is shown in Fig. [TJ The cross effects 
manifest themselves in a number of additional links which 
appear in the network during its return to equilibrium. 
In order to quantify the effects and check the correctness 
of our calculations we have measured the amplitude of 
the response function (see Fig. Q]) obtained from Monte 
Carlo simulations and compare it with both numerical 
solution of the set of initial rate Eqs. (fT5j) and the ex- 
act solution (fl8|) of the set of simplified Eqs. (fT7|) (see 
subset in Fig. [I]). The results are presented in Fig. [2] 
One can see that for 7 > 3 our analytical calculations 
fit numerical results very well. The visible discrepancy 
between the numerical results and their theoretical pre- 
dictions for 7 < 3 is due to the fact that the applied 
formalism does not take into account degree correlations 
which spontaneously develop in scale-free networks with 
7 < 3 (see comment after Eq. (28) in Q). 

In summary, in this paper we present Onsager for- 
malism applied to random networks with arbitrary de- 
gree distribution. Using the well-known methods of non- 
equilibrium thermodynamics we identify thermodynamic 
forces and their conjugated flows induced in networks as 
a result of single node degree perturbation. The forces 
and the flows can be understood as a response of the 
system to events, such as random removal of nodes or 
intentional attacks on them. We show that cross effects 
(such as thermodiffusion, or thermoelectric phenomena), 
in which one force may not only give rise to its own corre- 
sponding flow, but to many other flows, can be observed 
also in complex networks. 

Finally, since the science of complex networks is a gen- 
uinely multidisciplinary domain, the approach if applied 
to social, economic, or even biological networks may open 
new horizons for the sciences, as it would provide them 
with a completely new understanding of how rumors, in- 
formation, marketing, or crises can spread through these 
systems causing small, medium or large responses. More- 
over, if one can identify social (economic) equivalents of 
thermodynamic forces and flows, a social (economic) ana- 
logue of thermodynamic cross effects, underlying com- 
plexity of the socio-economic systems, will be within the 
grasp. We hope that the approach introduced in the pa- 
per will serve as a practical starting point for exploring 
a variety of non-equilibrium network-driven phenomena. 
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